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1.  Introduction  Let  S  be  a  countable  set  with  a  partial  ordering  denoted 

by  <.  Consider  a  discrete  time  Markov  chain  (Xn,  n  £  0)  with  state  space 

S,  and  transition  matrix  P.  Define  the  Markov  chain  to  have  monotone  paths 
if  Pr(Xn+1  >,  X„)  *  1.  Define  C  c  S  to  be  an  increasing  set  If  1  c  C  and 
j\>  i  Implies  j  €  c.  Define  the  Markov  chain  to  be  stochastically  monotone 
if  i  <_  j  implies  P(i,  C)  <  P(j,  C)  for  all  increasing  sets  C. 

For  a  state  i  and  set  C  define  T(i,C)to  be  the  first  passage  time  from 

1  to  C,  withT(i,C)  =  0  if  i  e  C,  and  T(i,C)=  «  if  c  is  never  reached.  Our 

main  result  (theorem  1)  is  that  for  a  stochastically  monotone  Markov  chain 
with  monotone  paths  on  a  partially  ordered  countable  set,  T(i,C)is  IFRA  for 
all  states  1  and  all  Increasing  sets  C  with  finite  complement.  (See  section 

2  for  a  definition  of  iFRA). 

Conversely,  every  discrete  IFRA  distribution  is  either  a  first  passage 
time  distribution  of  the  above  described  type  or  the  limit  of  a  sequence 
of  such  distributions  (corollary  1). 

Several  applications  of  theorem  1  are  presented  in  section  5.  These 
Include  coherent  systems,  shock  models,  convolutions  of  IFRA  distributions, 
multinomial  distributions,  and  sampling.  In  these  applications  S  Is  a  subset 
of  Rn  and  the  partial  ordering  Is  defined  by  x  <  ^  if  and  only  if  x.j  <  y^, 

1  ■  1,  ...  n.  The  possibility  exists  for  applications  to  a  wider  class 
of  partially  ordered  sets,  for  example  those  studied  In  combinatorial  theory 
(Rota  [14]) . 

The  question  arises  as  to  whether  the  conclusion  of  theorem  1  can  be 
strengthened  from  IFRA  to  IFR.  An  example  Is  given  to  show  that  even  for 
a  totally  ordered  set  the  first  passage  time  need  not  be  IFR.  However  for 
a  Markov  chain  on  the  positive  integers  with  TP2  transition  matrix  the  first 

passage  time  from  1  tod:  1>n},  n  ■  1,  2, . is  IFR.  This  Is  proved 

in  section  6.2. 
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Examples  are  given  which  demonstrate  that  even  for  a  totally  ordered 
set  the  IFRA  conclusion  does  not  follow  for  a  stochastically  monotone  chain 
without  monotone  paths  nor  for  a  non-stochastical ly  monotone  chain  with 
monotone  paths. 

By  a  uniformization  and  total  positivity  argument  the  result  (theorem  1) 
extends  to  continuous  time  Harkov  chains  with  countable  state  space.  An 
analogue  of  the  theorem  1  undoubtedly  holds  for  continuous  state  space. 

The  restriction  that  the  complement  of  C  be  finite  appears  to  be  a  limita¬ 
tion  of  our  methodology  rather  than  an  essential  condition. 

2.  Ha  in  result.  A  random  variable  Y  taking  values  in  {0,  1 . -}  is 

defined  to  be  IFRA  if  °ither  Pr(Y  =  0)  =  1,  or  Pr(Y  =  0)  =  0  and  [Pr(Y  >  k)]^k 
is  decreasing  in  k  *  1,  2,  ...  .  Included  as  IFRA  is  the  case  Pr(Y  =  -)  « 

1.  Note  that  if  Y  is  IFRA  and  Pr(Y  <  ®)  >0  then  Pr(Y  <  ®)  *  1. 

Thus  if  T(i,  C)  is  IFRA  then  either  1  €  C  (in  which  case  T(i,  C)  s  0), 
or  starting  in  i  it's  impossible  to  reach  C  (In  which  case  T(i,  C)  =  -), 
or  Pr(T(1 ,  C)  =  0)  =  Pr(T(i,  C)  =  -)  =  0  and  [Pr(T(i,  C)  >  k)]1/k  is  decreasing. 

Theorem  1  Let  {Xn,  n  >  0}  be  a  stochastically  monotone  Harkov  chain  with 
monotone  paths  on  the  partially  ordered  countable  set  S.  Let  C  be  an  increasing 
set  with  £  (the  complement  of  C  in  S)  finite.  Then  T(1,  C)  the  first  passage 
time  from  state  1  to  set  C,  is  IFRA. 

Proof  Define  ^(1,  C)  *  Pr(T(i,c)>  k).  Our  goal  Is  to  prove  thatCFk(1,  C)]^k 
is  decreasing,  equivalently  that: 


(1) 


crk(i,  C)]k+1  >  lTk+1(1,  C)]k,  k  -  1.  2,  ... 
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The  proof  Is  by  induction.  We  first  show  that  (1)  holds  for  k  *  1. 

It  is  trivially  true  for  i  e  C.  For  i  4  C  by  the  monotone  path  assumption: 

(2)  To(i,C)=  E  P(i,  b)P(b,  C) 

1  b>1  ,beC 

By  stochastic  monotonicity  b  i  implies  P(i,  C)  P(b,  C),  thus  from  (2): 

(3)  TJi,  C)  i  P(i,  C)  E  J>( i,  b)  =  (F.(1,  C))2 

4  b>i ,b«C  1 

Assume  now  that  (1)  holds  for  k  *  1 . t,  for  all_  increasing  sets  with 

finite  complement.  Define  Pk  to  be  the  k  step  transition  matrix  for  the 
llarkov  chain.  Now: 

(4)  (F*+1(i,C))£+2  «  f£+1(i,  C)[  zj>  (1,  b)P(b,  C)]£+1 

b«C 

By  stochastic  monotonicity  P(b,  C)  is  decreasing  in  b.  We  can  there¬ 
fore  label  the  finitely  many  points  in  C  by  bj,  bm  in  such  a  way  that 
P(bji  C)  <  P(b2,  C)  ...  <  P(bm,  C)  and  for  i  <  j,  b^  i  bj(bj  is  not  smaller 
than  bj  under  the  partial  ordering).  It  follows  that  the  sets  DQ  ■  C,  and 
Uj  *  C  -  (bji  ...  bj},  j  *  1,  ...  m  -  1,  are  finite  sets  which  are  complements 
of  increasing  sets.  The  induction  hypothesis  Is  thus  applicable  to  these 
sets.  Define  aj  *  P(bj,  C)  and  aj  =  P(bj,  C)  -  P(bj_^,  C),  j  ■  2,  ....  m,  and 
note  that  the  b's  have  been  labeled  so  that: 

( 5 )  ctj  ^  0|  j  *  1 1  ...  m 
Next: 

m  r  m 

(6)  VlC-  C>  ■  41P.(,-br> 

By  the  Induction  hypothesis: 

t 


(7) 


m 
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Note  that  In  (7)  if  i  4  th®11  both  sides  equal  zero,  and  (7)  is  valid. 

By  (4),  (5),  (6)  and  (7): 

1  m  * 

(8)  trl+1(i,  c)]‘+2  >  c(rttl(i,  c»*+1 1  «j(pul<i,  Oj.j))141]**1 

But,  £  a  Dj_i*  by  this  fact  and  the  monotone  path  assumption: 

(9)  T^+i(i *  C)  *  ( "• »  C)  )  =  •••  m* 

The  result  now  follows  from  (6)  (applied  to  t  +  1),  (8)  and  (9)  .  0 

3.  Continuous  time  Consider  a  stochastically  monotone  Markov  chain  with 
monotone  paths  and  countable  state  space.  Suppose  that  changes  of  state 
occur  according  to  a  Poisson  process  with  rate  X.  Define  T*(i,  C)  to  be 
the  first  passage  time  (in  continuous  time)  from  state  i  to  C,  an  increasing 
set  with  finite  complement.  Now: 

Pr(T*(i ,  C)  >  t)  *  l  Pr(T(i ,  C)  >  k) 

k*l  *• 

By  theorem  1  and  theorem  3.6,  page  93  of  Barlow  and  Proschan  [1],  T*(i,  C) 
is  IFKA. 

Next,  consider  a  continuous  time  Markov  chain  with  infinitesimal  matrix 
A  taking  values  in  a  partially  ordered  countable  set.  Assume  that  the  Markov 
chain  has  monotone  paths,  equivalently  that  A(i,  j)  t  0  implies  1  ^  j. 

Assume  that  the  process  Is  uniformizable,  1.  e.  that  sup(-Mi,i))<  •. 

By  Feller  [8]  p.  312,  the  Markov  process  Is  representable  as  a  Markov 
chain  with  transition  matrix  P  ■  I  +  j  for  which  transitions  occur  according 
to  a  Poisson  process  of  rate  x.  The  Harkov  chain  with  transition  matrix  P 
Inherits  monotone  pat.'.s.  In  view  of  monotone  p.itlis,  the  Markov  chain  Is 
stochastically  monotone  if  and  only  if  A(1,  C)  »  i  A(1,  t)  <  A(j,  C)  for 
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all  increasing  sets  C  with  finite  complement  and  i  £  j  with  both  i  and  j 
in  C.  It  follows  from  theorem  1  and  the  remarks  at  the  beginning  of  this 
section  that  the  first  passage  time  to  C  for  the  continuous  time  process 
is  IFRA.  To  summarize: 

Corollary  1  (i)  Consider  a  Markov  chain  of  the  type  described  in  theorem  1. 

Suppose  that  transitions  occur  according  to  a  Puisson  process.  Then  the 
first  passage  time  in  continuous  time  from  i  4  C  to  C,  an  increasing  set 
with  finite  complement,  is  IFRA. 

(ii)  Consider  a  Harkov  chain  in  continuous  time  with  countable  partially 
ordered  state  space  and  infinitesimal  matrix  A.  Assume  that: 

(i)  sup(-A(i,i ))<  « 

(ii)  A(i,  j)  t  0  implies  i  <_  j 

(iii)  A(i,  C)  <  A( j ,  C)  for  all  increasing 
sets  C  with  finite  complement,  and  pairs 

of  states  (i,  j)  with  i  <  j  and  i,  j  both  in  C. 

Then  the  first  passage  time  from  i  \  C  to  C,  an  increasing  set  with 
finite  complement,  is  IFRA. 

4.  Converse  He  will  reinterpret  a  result  of  Birnbaum,  Esary,  and  Marshall  [2] 
(described  in  Barlow  and  Proschan  Cl],  lemma  2.13,  page  88)  in  terms  of 
Harkov  chains.  The  analogue  of  chelr  result  in  the  discrete  case  provides 
a  converse  to  theorem  1. 

The  result  Is  that  every  IFRA  distribution  in  continuous  time  is  either 
the  system  life  for  a  coherent  system  of  Independent  exponential  components, 
or  Is  the  limit  distribution  of  a  sequence  of  such  system  lives.  But  a 
coherent  system  of  n  independent  exponential  components  Is  a  continuous 
time  Markov  process  on  the  set  of  the  2n  n-tuples  of  0's  and  l's  with  partial 
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ordering  x  <  £  if  and  only  if  x^  <  y,,  i  =  1,  ...  n.  iioreover  the  process 
is  stochastically  monotone  with  monotone  paths,  and  the  system  lifetime 
is  the  first  passage  time  to  an  increasing  set.  Thus  every  IFRA  distribution 
in  continuous  time  is  either  a  first  passage  time  distribution  of  the  above 
described  type  or  tfie  limit  of  a  sequence  of  such  first  passage  time  distri¬ 
butions. 

Replacing  continuous  time  by  discrete  time  and  exponential  distributions 
by  geometric  distributions,  we  can  imitate  their  proof  and  obtain  the  following 
resul t . 

Lemma  1  Every  IFRA  distribution  in  discrete  time  is  either  the  first  passage 
time  distribution  to  an  increasing  set  for  a  stochastically  monotone  Markov 
chain  with  monotone  pa«.hs  on  a  partially  ordered  finite  set,  or  else  is 
the  limit  of  a  sequence  of  such  distributions. 

5.  Appl ications 

(5.1)  Coherent  Systems  Consider  a  coherent  system  of  n  independent  components 

(Barlow  and  Proschan  [1],  chapter  1,  section  2).  Assume  that  the  survival  function 

_  x.- 

for  component  i  is  given  by  (F( t ) )  ,  1  =  1,  ....  n  where  F  is  continuous. 

This  is  known  as  the  proportional  hazard  assumption.  Each  component  starts 
off  In  state  0,  remains  in  0  until  failure,  at  which  time  it  switches  to 
state  1  and  stays  there  forever.  The  system  fails  as  soon  as  the  state 
vector  visits  B,  an  increasing  set.  In  this  case  S  is  the  set  of  2n  n-tuples 
of  0's  and  l's  with  partial  order  x  <  £  <“>  x^  y^ ,  i  =1,  ...  n. 

Consider  the  embedded  discrete  time  process,  starting  in  state  (0,  ....  0), 
and  changing  state  each  time  a  component  falls.  Under  the  proportional 
hazard  assumption  this  process  is  a  Markov  chain.  If  the  set  of  working 
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components  at  a  given  instant  is  A,  then  given  that  a  change  of  state  occurs, 

the  probability  that  component  i  e  A  failed  is  given  by  X../EX-.  The  Markov 

1  A  J 

chain  is  easily  seen  to  be  stochastically  monotone  with  monotone  paths. 
Therefore  by  theorem  1  the  number  of  component  failures  until  system  failure 
is  IFRA.  This  generalizes  a  result  of  Ross,  Shashahani,  and  Weiss  [13], 
who  proved  the  IFRA  property  in  the  case  of  i.i.d.  components  with  continuous 
distribution  (x^  =  x). 

By  corollary  1,  if  the  component  lifetimes  are  exponential  then  the 
time  to  first  failure  for  the  continuous  time  process  is  IFRA.  This  is 
a  special  case  of  the  IFRA  closure  theorem  (Barlow  and  Proschan  [1]  p.  85). 


5.2  Shock  models  Assume  that  Yj,  Y^.  ...  are  i.i.d.  random  vectors. 

The  set  S  consists  of  vectors  of  the  form  (XjWj  ...  Xyt^)  where  w  *  (wj,  ...  wk) 
is  a  fixed  vector  of  positive  numbers  and  the  t's  are  non-negative  integer 


valued.  Define  Sn  =  £Y. ,  n  =  1,  2,  ...  .  Then  {Sn,  n  >  1}  is  a  stochasti- 

n  X  *  " 

cally  monotone  Markov  chain  with  monotone  paths,  and  theorem  1  is  applicable. 
Let  g  be  a  function,  R+  -*■  R+  =  [0,  »),  which  is  increasing  in  each  argument 
and  winch  goes  to  ®  as  x^  ♦  «  with  (x^  ...  x^_j,  x..+1,  ...  xk)  held  fixed, 
for  i  =  1,  ...  k.  Then  the  first  n  such  that  g(Sn)  exceeds  a  given  constant 
y  is  IFRA.  This  is  true  because  the  set  (x:  g(x)  >  y)  is  an  increasing 
set  with  finite  complement. 

i.  L 

Interpreting  Y..  as  the  joint  damage  to  k  components  due  to  the  iu 
shock,  g  as  the  rule  for  converting  component  damage  Into  system  damage, 
and  y  as  the  damage  threshold  beyond  which  the  system  fails,  it  follows 
that  the  number  of  shocks  required  for  system  failure  is  IFRA. 

More  generally  the  damage  caused  by  a  shock  may  depend  on  the  previously 


accumulated  damage.  As  long  as  damage  is  non-negative  and  the  Markov  chain 
remains  stochastically  monotone,  the  IFRA  conclusion  will  hold. 
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If  shocks  occur  in  time  according  to  a  Poisson  process  then  by  lemma  1 
the  waiting  time  (in  continuous  time)  until  system  failure  is  IFRA. 

Finally  if  the  damages  are  not  of  arithmetic  type,  i.e.  concentrated 
on  a  set  S  as  described  above,  but  are  still  componentwise  non-negative, 
then  by  passage  to  the  limit  through  approximating  vectors  of  arithmetic 
type  it  follows  that  the  time  to  system  failure  is  IFRA.  This  is  true  for 
the  discrete  time  process  and  for  the  continuous  time  process  v/hen  shocks 
occur  according  to  a  Poisson  process. 

Thus  the  classic  shock  model  results  of  Esary,  Marshall,  and  Proschan 
[7]  are  derivable  from  theorem  1  and  corollary  1,  as  well  as  the  IFRA  char¬ 
acter  of  the  number  of  shocks  until  system  failure.  Moreover  the  current 
results  are  more  general  in  that  they  allow  for  vector  valued  component 
damages  and  general  system  damage  function  g. 

5.3  tultinomial  distributions  Consider  i.i.d.  observations  from  a  multi¬ 
nomial  distribution.  Define  S„  =  (S.  ...  S„„)  where  S„,.  is  the  number 

n  ni  nK  ru 

of  times  category  1  appears  in  the  first  n  observations.  Then  {Sn,  n  1} 
is  a  Markov  chain  of  the  type  considered  in  example  (5.1),  i.e.  the  partial 
sums  of  i.i.d.  random  vectors  with  arithmetic  distribution. 

The  following  random  variables  are  thus  IFRA: 

The  number  of  observations  required  until  each  category  appears  at  least 
once;  until  at  least  r  categories  each  appear  at  least  m  times;  until  g(Sn) 
exceeds  y  where  g  is  described  in  section  (5.2). 

(5.4)  Sampling  with  or  without  replacement  Sampling  with  replacement 
Is  covered  by  (5.2)  above.  For  sampling  without  replacement  suppose  that 
an  urn  contains  m^  balls  of  color  i,  1  ■  1,  ... 


k.  Then  the  following  random 
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variables  are  IFRA.  The  number  of  balls  sampled  until  all  balls  of  at  least 
one  color  are  depleted;  until  at  least  one  ball  of  each  color  is  sampled; 
until  at  least  ri  balls  of  type  i,  i  =  1,  ...  k  are  sampled;  until  at  least 
i  of  the  events  ...  Ak  occur,  where  A-  =  {at  least  ri  balls  of  type  i 

are  sampled}.  The  last  case  includes  the  first  three. 


(5.5)  Convolutions  Consider  two  Markov  chains  of  the  type  described  in  theorem  1, 
with  finite  state  spaces  S1  and  S2»  and  transition  matrices  Qj  and  Qg.  Let 
Cj  be  an  increasing  set  in  Define  a  new  Markov  chain  on  x  S2,  with 
product  partial  ordering,  by 


(10) 


P((i,  j),  (i ' »  J* )) 


j  1  i  € 

j  Q1<i >  i‘)Q2(3.  3’),  1  e  Cj 


It  follows  that  the  Markov  chain  is  stochastically  monotone  with  monotone 
paths  and  finite  state  space.  Theorem  1  is  thus  applicable. 

Consider  the  set  C^  x  c2  where  C2  is  an  increasing  set  in  S2-  Since 
both  Sj  and  S2  are  finite  so  is  x  C2  .  Starting  in  state  (i,  j)  with 
i  £  tj,  j  £  ?2,  the  first  passage  time  from  (i,  j)  to  C^  x  C2  is  the  sum 
of  T(i,  Cj)  and  T(j,  C2)  where  the  two  are  independent.  Therefore  the  convo¬ 
lution  of  two  IFRA  distributions,  each  of  which  is  a  first  passage  time 
distribution  to  an  increasing  set  in  a  stochastically  monotone  Markov  chain 
■with  monotone  paths  on  a  finite  state  space,  is  IFRA.  But  by  lemma  1  every 
IFRA  distribution  is  either  of  this  form  or  the  limit  of  a  sequence  of  IFRA 
distributions  of  this  form.  It  follows  that  the  class  of  discrete  IFRA 
distributions  is  closed  under  convolutions. 

The  closure  of  IFRA  distributions  under  convolutions  in  the  continuous 
case  was  proved  by  Block  and  Savits  [3].  In  [4]  Block  and  Savits  prove 
that  closure  In  the  continuous  case  follows  from  closure  in  the  discrete  case. 
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6.  Comments  and  Additions. 

(6.1)  The  following  example  shows  that  under  the  conditions  of  theorem 

1  the  conclusion  cannot  be  strengthened  from  IFRA  to  IFR  even  when  the  state 

space  is  totally  ordered.  Let  (Y^,  i  1)  be  i.i.d.  with  Pr(Y  =  9)  =  Pr(Y  *  2)  *  -j. 

n 

Define  Sn  =  £Y.j,  n  1;  Sn  is  a  iiarkov  process  on  the  integers.  It  is  sto¬ 
chastically  monotone  and  has  monotone  paths.  Consider,  T,  the  first  passage 

time  to  (10,  11,  12,  . }.  .tow  Pr(T  =  2|T  >  2)  =  |  while  Pr(T  =  3|T  >  3)  = 

therefore  the  failure  rate  at  3  is  less  than  the  failure  rate  at  2  and 
the  distribution  is  not  IFR. 


(6.2)  Consider  a  Iiarkov  chain  on  [1,  2,  ...  ].  Assume  that  the  transi¬ 
tion  matrix  is  TP2,  i.e.  that  P(i,  j)P(i‘»  j')  >.  P(i,  j')P(i'»  j)  for  all 
1  <  i ' ,  j  <  j'.  Lemma  2  below  shows  that  the  first  passage  time  from  state 

1  to  Cn  =  (i :  i  >  n>  is  IFR  (increasing  failure  rate)  for  n  =  1,  2 . 

A  random  variable  T  is  defined  to  be  IFR  if  X,  =  Pr(T  =  k)/Pr(T  >  k)  is 
increasing. 

Lemma  2  In  a  Harkov  chain  with  state  space  {1,  2,  and  TPg  transition 

matrix  P,  the  first  passage  time  T(l,  Cn),  from  state  1  to  Cn  =  (i;  i  >  n} 
is  IFR  for  n  =  1,  2,  ...  . 

Proof  Define  Pk(l,  i)  *  Pr(T(l,  Cn)  >  k,  Xk  =  i|Xg  *  1),  i  *  1,  ...  n. 

Then  Xk,  the  failure  rate  for  T(l,  Cn)  at  k  is  given  by: 

^Pk-1(l*i)p(i,Cn) 

U1)  X|<  =  - - n - »  k  =  1»  2 . 

itow,  from  (11): 


U-)  xkfl  -  x,. 


I  CP(1.C  )-p(j,c  )j[Pk _1(i.j)Pk(i,i)-Pk.l(i,i)Pk(iJ>] 

l<3<l<n 

pk+l^’  ^ 
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It  follows  from  theorem  2.2  of  Karlin  [10]  that: 


(13)  P^d,  j)Pk(l,  1)  -  P^U,  1)Pk(l,  j)  >  0 

And  by  stochastic  monotonicity  (which  is  implied  by  TP2): 


(14)  P(i,  Cn)  >  P(j,.Cn)  for  i  >  j 

Thus  from  (12),  (13)  and  (14),  is  increasing  and  T(l,  Cn)  is  thus  IFR.  fl 

The  above  proof  also  shows  that  in  a  TPg  Harkov  chain  if  for  some  i'q 
P(i ,  j)  =  0  for  all  1  >.  1q,  j  <  i,  then  T(iQ,  Cn)  is  IFR  for  n  ^  iQ.  In 
particular  if  the  Harkov  chain  has  monotone  paths  then  the  above  holds  for  all  iQ. 

It  follows  from  lemma  2  that  for  a  ±1  random  walk  with  reflecting  bar¬ 
rier  at  0,  starting  at  0,  that  the  number  of  trials  required  to  reach  m 
for  the  first  time  is  IFR.  Using  the  argument  of  corollary  1  which  extends 
the  discrete  time  result  to  continuous  time,  it  follows  that  for  a  birth 
and  death  process  the  time  required  to  go  from  0  to  the  first  visit  to  m 
is  IFR  for  all  m.  This  result  was  obtained  using  differents  methods  by 
Keilson  [11],  and  Derman,  Ross  and  Schechner  [6], 


(6.3)  If  the  Harkov  chain  is  stochastically  monotone  but  without  monotone 
paths  then  the  IFRA  concision  need  not  hold.  For  example  in  the  following 
chain  the  first  passage  time  from  state  2  to  state  3  is  DFRA  (decreasing 
failure  rate  on  the  average). 


•3 

!  * 


p 


_!  1 
'  7 

0 


0 

0 


One  might  attribute  the  above  example  to  the  fact  that  starting  in 


state  2  it's  possible  to  go  to  state  1  which  has  smaller  failure  rate  than 
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state  2  (i.e.  P(l,  3)  <  P(2,  3)).  This  might  be  eliminated  if  we  required 
the  chain  to  start  in  its  smallest  state.  In  the  following  example  however 
the  first  passage  time  from  state  1  to  state  3  is  not  IFRA. 

I • 18  .09  .73  ^ 

P  =  ■  .17  0  .83  i 

0  0  1  f 

,k 

In  this  example  the  average  failure  rate  Yk  =  ^lPr(T  =  j|T  >  j)  equals 
.755763  for  k  =  18,  and  .755696  for  k  =  19.  Since  y^  is  not  increasing 
it  follows  from  [12],  lemma  1,  that  T  is  not  IFRA.  It  is  true  however  that 
T  is  I18U  (see  section  6.5). 


(6.4)  In  the  following  example  the  Markov  chain  has  monotone  paths  but 
is  not  stochastically  monotone.  The  first  passage  time  from  state  1  to 
state  3  is  DFRA. 


-0 


/ 

i 

i 

P  =  0 

0 


1  1 
1  1 


3 


II 


(6.5)  For  a  stochastically  monotone  Markov  chain  on  the  real  numbers, 

T(x,  C)  is  stochastically  decreasing  in  x  for  all  increasing  sets  C.  This 

is  true  because  by  Le.mcnn  [12]  p.  73,  for  x  <  y,  we  can  construct  a  bivariate 

X_ 

version  of  the  Markov  chain,  {(y  ),  n  >_  0)  with  XQ  =  x,  YQ  -  y,  and 

n 

Xn  <  Yn  for  all  n;  in  this  construction  (Xn,  n  0>((Yn,  n  0))  Is  distri¬ 
buted  as  the  given  rlarkov  chain  starting  in  x(y). 

It  Immediately  follows  that  if  the  state  space  Is  a  subset  of  [a,  «) 
which  Includes  a  then  T(a,  C)  is  NBU  for  all  increasing  sets  C.  A  random 
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variable  on  (0,  1,  2,  . }  is  defined  to  be  WBU  if  Pr(T  >.  r  +  s) 

Pr(T  2  r)Pr(T  >.  s),  for  r,  s  *  1,  2,  ...  .  The  NGU  property  is  weaker 
than  IFRA. 

Define  a  partially  ordered  set  S  to  be  of  type  L  if  Pj(C)  <  Pg( C)  for 

-  V 

all  increasing  sets  C  implies  that  there  exist  random  elements  (y)  with 
X  ~  Pj,  Y  ~  P2  and  Pr(X  <_  Y)  =  1.  By  Lei;  ann  [12]  p.  73,  the  real  line  with 
the  usual  stochastic  ordering  is  of  type  L.  Kamae,  Krengel ,  and  O'Brien 
[9]  show  that  a  Polish  space  endowed  with  a  closed  partial  ordering  is  of 
type  L. 

It  follows  that  for  a  stochastically  monotone  Markov  chain  on  a  type 
L  partially  ordered  set  S  that  T(x,  C)  is  stochastically  decreasing  in  x 
for  all  increasing  sets  C.  Moreover,  if  a  <  x  for  all  x  e  S,  then  T(a,  C) 
is  WBU. 


(6.6)  The  definition  of  IFRA  for  discrete  distributions  followed  here 
(section  2)  is  the  same  as  in  Barlow-Proschan  [1],  p.  94,  and  Block  and 
Savits  [4],  Ross,  Shashahani  and  Weiss  [13]  use  the  term  SSLSF  (star-shaped 
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